Pandas Profiling Report

Dataset statistics

Number of variables	8
Number of observations	27502
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	29
Duplicate rows (%)	0.1%
Total size in memory	1.7 MiB
Average record size in memory	64.0 B

Variable types

NUM	8

Warnings

Dataset has 29 (0.1%) duplicate rows	Duplicates
`DayLength(s)` is highly correlated with `DayofYear`	High correlation
`DayofYear` is highly correlated with `DayLength(s)`	High correlation
`Speed` has 403 (1.5%) zeros	Zeros

Reproduction

Analysis started	2020-09-19 22:12:16.273481
Analysis finished	2020-09-19 22:12:35.955045
Duration	19.68 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

Radiation
Real number (ℝ_≥0)

Distinct	10894
Distinct (%)	39.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	148.9496975
Minimum	1.11
Maximum	883.66
Zeros	0
Zeros (%)	0.0%
Memory size	214.9 KiB

Quantile statistics

Minimum	1.11
5-th percentile	1.19
Q1	1.22
median	1.47
Q3	219.9425
95-th percentile	756.716
Maximum	883.66
Range	882.55
Interquartile range (IQR)	218.7225

Descriptive statistics

Standard deviation	249.1978092
Coefficient of variation (CV)	1.673033336
Kurtosis	1.196441045
Mean	148.9496975
Median Absolute Deviation (MAD)	0.3
Skewness	1.590172796
Sum	4096414.58
Variance	62099.54812
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1.22	2140	7.8%
1.23	1991	7.2%
1.21	1906	6.9%
1.24	1609	5.9%
1.2	1460	5.3%
1.25	1089	4.0%
1.19	905	3.3%
1.26	683	2.5%
1.18	437	1.6%
1.27	415	1.5%
Other values (10884)	14867	54.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1.11	1	< 0.1%
1.13	4	< 0.1%
1.14	4	< 0.1%
1.15	34	0.1%
1.16	73	0.3%

Value	Count	Frequency (%)
883.66	1	< 0.1%
883.59	1	< 0.1%
883.45	1	< 0.1%
883.43	1	< 0.1%
883.37	1	< 0.1%

Temperature
Real number (ℝ_≥0)

Distinct	33
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	50.47796524
Minimum	36
Maximum	68
Zeros	0
Zeros (%)	0.0%
Memory size	214.9 KiB

Quantile statistics

Minimum	36
5-th percentile	44
Q1	46
median	49
Q3	54
95-th percentile	61
Maximum	68
Range	32
Interquartile range (IQR)	8

Descriptive statistics

Standard deviation	5.476834358
Coefficient of variation (CV)	0.1084995073
Kurtosis	-0.1143470163
Mean	50.47796524
Median Absolute Deviation (MAD)	3
Skewness	0.6338528336
Sum	1388245
Variance	29.99571459
Monotocity	Not monotonic

Histogram with fixed size bins (bins=33)

Value	Count	Frequency (%)
45	2659	9.7%
48	2483	9.0%
47	2335	8.5%
46	2039	7.4%
50	1950	7.1%
49	1849	6.7%
51	1770	6.4%
52	1410	5.1%
44	1172	4.3%
53	1159	4.2%
Other values (23)	8676	31.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
36	15	0.1%
37	38	0.1%
38	24	0.1%
39	37	0.1%
40	153	0.6%

Value	Count	Frequency (%)
68	31	0.1%
67	35	0.1%
66	75	0.3%
65	116	0.4%
64	190	0.7%

Pressure
Real number (ℝ_≥0)

Distinct	25
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	30.43094829
Minimum	30.31
Maximum	30.55
Zeros	0
Zeros (%)	0.0%
Memory size	214.9 KiB

Quantile statistics

Minimum	30.31
5-th percentile	30.35
Q1	30.41
median	30.43
Q3	30.46
95-th percentile	30.49
Maximum	30.55
Range	0.24
Interquartile range (IQR)	0.05

Descriptive statistics

Standard deviation	0.04165413148
Coefficient of variation (CV)	0.001368808197
Kurtosis	0.4104691043
Mean	30.43094829
Median Absolute Deviation (MAD)	0.03
Skewness	-0.4887204442
Sum	836911.94
Variance	0.001735066669
Monotocity	Not monotonic

Histogram with fixed size bins (bins=25)

Value	Count	Frequency (%)
30.44	2941	10.7%
30.43	2826	10.3%
30.45	2707	9.8%
30.42	2538	9.2%
30.46	2427	8.8%
30.41	2056	7.5%
30.47	1953	7.1%
30.4	1779	6.5%
30.48	1433	5.2%
30.39	1347	4.9%
Other values (15)	5495	20.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
30.31	277	1.0%
30.32	292	1.1%
30.33	253	0.9%
30.34	402	1.5%
30.35	291	1.1%

Value	Count	Frequency (%)
30.55	31	0.1%
30.54	75	0.3%
30.53	55	0.2%
30.52	159	0.6%
30.51	260	0.9%

Humidity
Real number (ℝ_≥0)

Distinct	94
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	75.83913897
Minimum	8
Maximum	103
Zeros	0
Zeros (%)	0.0%
Memory size	214.9 KiB

Quantile statistics

Minimum	8
5-th percentile	25
Q1	57
median	87
Q3	98
95-th percentile	102
Maximum	103
Range	95
Interquartile range (IQR)	41

Descriptive statistics

Standard deviation	26.17651351
Coefficient of variation (CV)	0.345158369
Kurtosis	-0.7036660498
Mean	75.83913897
Median Absolute Deviation (MAD)	14
Skewness	-0.8270219108
Sum	2085728
Variance	685.2098597
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
102	1964	7.1%
101	1895	6.9%
93	1491	5.4%
100	1402	5.1%
99	1111	4.0%
98	855	3.1%
97	725	2.6%
96	651	2.4%
95	635	2.3%
94	507	1.8%
Other values (84)	16266	59.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
8	1	< 0.1%
11	4	< 0.1%
12	11	< 0.1%
13	33	0.1%
14	36	0.1%

Value	Count	Frequency (%)
103	93	0.3%
102	1964	7.1%
101	1895	6.9%
100	1402	5.1%
99	1111	4.0%

WindDirection(Degrees)
Real number (ℝ_≥0)

Distinct	15152
Distinct (%)	55.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	132.4715181
Minimum	0.09
Maximum	324.93
Zeros	0
Zeros (%)	0.0%
Memory size	214.9 KiB

Quantile statistics

Minimum	0.09
5-th percentile	18.721
Q1	84.5
median	143.88
Q3	172.86
95-th percentile	236.887
Maximum	324.93
Range	324.84
Interquartile range (IQR)	88.36

Descriptive statistics

Standard deviation	66.00487201
Coefficient of variation (CV)	0.4982570817
Kurtosis	0.1717425168
Mean	132.4715181
Median Absolute Deviation (MAD)	36.77
Skewness	0.110164165
Sum	3643231.69
Variance	4356.643129
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.11	63	0.2%
0.1	38	0.1%
85.39	25	0.1%
0.12	20	0.1%
25.99	16	0.1%
191.13	14	0.1%
85.4	12	< 0.1%
153.25	12	< 0.1%
178.25	12	< 0.1%
183.01	11	< 0.1%
Other values (15142)	27279	99.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.09	2	< 0.1%
0.1	38	0.1%
0.11	63	0.2%
0.12	20	0.1%
0.13	5	< 0.1%

Value	Count	Frequency (%)
324.93	1	< 0.1%
324.88	2	< 0.1%
324.87	2	< 0.1%
324.85	1	< 0.1%
324.71	1	< 0.1%

Speed
Real number (ℝ_≥0)

ZEROS

Distinct	14
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	6.017859792
Minimum	0
Maximum	14.62
Zeros	403
Zeros (%)	1.5%
Memory size	214.9 KiB

Quantile statistics

Minimum	0
5-th percentile	1.12
Q1	3.37
median	5.62
Q3	7.87
95-th percentile	11.25
Maximum	14.62
Range	14.62
Interquartile range (IQR)	4.5

Descriptive statistics

Standard deviation	2.996703486
Coefficient of variation (CV)	0.4979683125
Kurtosis	-0.1790622997
Mean	6.017859792
Median Absolute Deviation (MAD)	2.25
Skewness	0.4021007752
Sum	165503.18
Variance	8.980231782
Monotocity	Not monotonic

Histogram with fixed size bins (bins=14)

Value	Count	Frequency (%)
5.62	3959	14.4%
4.5	3861	14.0%
6.75	3724	13.5%
3.37	3355	12.2%
7.87	3060	11.1%
2.25	2369	8.6%
9	2139	7.8%
10.12	1450	5.3%
1.12	1164	4.2%
11.25	902	3.3%
Other values (4)	1519	5.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	403	1.5%
1.12	1164	4.2%
2.25	2369	8.6%
3.37	3355	12.2%
4.5	3861	14.0%

Value	Count	Frequency (%)
14.62	191	0.7%
13.5	365	1.3%
12.37	560	2.0%
11.25	902	3.3%
10.12	1450	5.3%

DayofYear
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	119
Distinct (%)	0.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	304.928987
Minimum	245
Maximum	366
Zeros	0
Zeros (%)	0.0%
Memory size	214.9 KiB

Quantile statistics

Minimum	245
5-th percentile	251
Q1	277
median	305
Q3	331
95-th percentile	360
Maximum	366
Range	121
Interquartile range (IQR)	54

Descriptive statistics

Standard deviation	33.90880953
Coefficient of variation (CV)	0.1112023159
Kurtosis	-1.064740558
Mean	304.928987
Median Absolute Deviation (MAD)	27
Skewness	0.04794382677
Sum	8386157
Variance	1149.807364
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
356	284	1.0%
337	284	1.0%
329	283	1.0%
359	282	1.0%
303	281	1.0%
327	279	1.0%
328	278	1.0%
334	277	1.0%
357	277	1.0%
363	277	1.0%
Other values (109)	24700	89.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
245	100	0.4%
246	215	0.8%
247	253	0.9%
248	263	1.0%
249	236	0.9%

Value	Count	Frequency (%)
366	148	0.5%
365	136	0.5%
364	273	1.0%
363	277	1.0%
362	266	1.0%

DayLength(s)
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	75
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	41495.97557
Minimum	39360
Maximum	45060
Zeros	0
Zeros (%)	0.0%
Memory size	214.9 KiB

Quantile statistics

Minimum	39360
5-th percentile	39360
Q1	39840
median	41160
Q3	42900
95-th percentile	44760
Maximum	45060
Range	5700
Interquartile range (IQR)	3060

Descriptive statistics

Standard deviation	1774.647417
Coefficient of variation (CV)	0.04276673564
Kurtosis	-1.109184696
Mean	41495.97557
Median Absolute Deviation (MAD)	1500
Skewness	0.4303165498
Sum	1141222320
Variance	3149373.455
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
39360	2996	10.9%
39420	1362	5.0%
39600	571	2.1%
39900	551	2.0%
40020	549	2.0%
40320	546	2.0%
41160	543	2.0%
40080	542	2.0%
42840	536	1.9%
41340	532	1.9%
Other values (65)	18774	68.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
39360	2996	10.9%
39420	1362	5.0%
39480	235	0.9%
39540	290	1.1%
39600	571	2.1%

Value	Count	Frequency (%)
45060	202	0.7%
45000	221	0.8%
44880	261	0.9%
44820	469	1.7%
44760	230	0.8%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

First rows

	Radiation	Temperature	Pressure	Humidity	WindDirection(Degrees)	Speed	DayofYear	DayLength(s)
0	1.21	48	30.46	59	177.39	5.62	274	43200
1	1.21	48	30.46	58	176.78	3.37	274	43200
2	1.23	48	30.46	57	158.75	3.37	274	43200
3	1.21	48	30.46	60	137.71	3.37	274	43200
4	1.17	48	30.46	62	104.95	5.62	274	43200
5	1.21	48	30.46	64	120.20	5.62	274	43200
6	1.20	49	30.46	72	112.45	6.75	274	43200
7	1.24	49	30.46	71	122.97	5.62	274	43200
8	1.23	49	30.46	80	101.18	4.50	274	43200
9	1.21	49	30.46	85	141.87	4.50	274	43200

Last rows

	Radiation	Temperature	Pressure	Humidity	WindDirection(Degrees)	Speed	DayofYear	DayLength(s)
27492	1.20	43	30.42	101	150.62	6.75	336	39660
27493	1.19	43	30.42	101	178.46	5.62	336	39660
27494	1.19	44	30.42	101	148.63	3.37	336	39660
27495	1.21	44	30.42	101	101.27	10.12	336	39660
27496	1.18	44	30.42	102	121.02	4.50	336	39660
27497	1.22	44	30.43	102	145.42	6.75	336	39660
27498	1.17	44	30.42	102	117.78	6.75	336	39660
27499	1.20	44	30.42	102	145.19	9.00	336	39660
27500	1.23	44	30.42	101	164.19	7.87	336	39660
27501	1.20	44	30.43	101	83.59	3.37	336	39660

Most frequent

	Radiation	Temperature	Pressure	Humidity	WindDirection(Degrees)	Speed	DayofYear	DayLength(s)	count
15	1.28	49	30.41	102	85.39	0.00	346	39420	4
0	1.21	41	30.32	89	188.96	5.62	365	39420	3
2	1.22	45	30.32	93	211.82	1.12	339	39660	3
1	1.21	47	30.44	90	166.76	1.12	280	42720	2
3	1.23	45	30.31	102	162.87	2.25	365	39420	2
4	1.23	45	30.35	93	238.13	2.25	340	39600	2
5	1.23	45	30.36	93	188.38	1.12	340	39600	2
6	1.23	48	30.43	99	208.97	4.50	259	44160	2
7	1.23	49	30.44	96	283.21	2.25	259	44160	2
8	1.23	50	30.45	98	179.17	3.37	268	43500	2

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows

Duplicate rows

Most frequent